Low Complexity Linear Programming Decoding of 

Nonbinary Linear Codes 



Mayur Punekar and Mark F. Flanagan 

Claude Shannon Institute, 

University College Dublin, Belfleld, Dublin 4, Ireland. 

{mayur.punekar, mark.flanagan} @ieee.org 



o 

•4— > 
O 

O 






CN 
> 

oo 
\o 
m 

o 
o 

> 

X 



Abstract — Linear Programming (LP) decoding of Low-Density 
Parity-Check (LDPC) codes has attracted much attention in 
the research community in the past few years. The aim of LP 
decoding is to develop an algorithm which has error-correcting 
performance similar to that of the Sum-Product (SP) decoding 
algorithm, while at the same time it should be amenable to math- 
ematical analysis. The LP decoding algorithm has been derived 
for both binary and nonbinary decoding frameworks. However, 
the most important problem with LP decoding for both binary 
and nonbinary linear codes is that the complexity of standard 
LP solvers such as the simplex algorithm remain prohibitively 
large for codes of moderate to large block length. To address this 
problem, Vontobel et al. proposed a low complexity LP decoding 
algorithm for binary linear codes which has complexity linear in 
the block length. In this paper, we extend the latter work and 
propose a low-complexity LP decoding algorithm for nonbinary 
linear codes. We use the LP formulation for the nonbinary codes 
as a basis and derive a pair of primal-dual LP formulations. 
The dual LP is then used to develop the low-complexity LP 
decoding algorithm for nonbinary linear codes. The complexity 
of the proposed algorithm is linear in the block length and is 
limited mainly by the maximum check node degree. As a proof 
of concept, we also present a simulation result for a [80, 48] 
LDPC code defined over Z4 using quaternary phase-shift keying 
over the AWGN channel, and we show that the error-correcting 
performance of the proposed LP decoding algorithm is similar 
to that of the standard LP decoding using the simplex solver. 

I. INTRODUCTION 

Low-Density Parity-Check (LDPC) codes belong to the 
class of capacity achieving codes. They were introduced in 
the early 1960s by Gallager [1| but attracted the attention 
of the research community only after they were rediscovered 
by MacKay et al. in the late 1990s [2|. LDPC codes are 
generally decoded by the belief propagation algorithm (also 
known as the Sum-Product (SP) algorithm) which has time 
complexity linear in the block length. However, binary LDPC 
codes suffer from an error floor effect in the high SNR 
region. Some progress has been made in the direction of finite 
length analysis of LDPC codes and concepts such as graph- 
cover pseudocodewords, trapping sets, stopping sets etc. were 
introduced and investigated to understand the behavior of the 
SP algorithm. Nevertheless, finite length analysis of LDPC 
codes under the SP algorithm is a difficult task and it is still 
difficult to predict error floor behavior for a particular code. 

The main focus of research in the area of LDPC codes has 
been on binary LDPC codes. However, it is desirable to use 
nonbinary LDPC codes in many applications where bandwidth 



efficient higher order (i.e. nonbinary) modulation schemes are 
used. Nonbinary LDPC codes are also considered for storage 
applications [12]. Nonbinary LDPC codes and the correspond- 
ing nonbinary SP algorithm were investigated by Davey and 
MacKay in |3| and since then many code construction methods 
and optimized nonbinary SP algorithms have been proposed. 
However, finite length analysis of nonbinary LDPC codes 
under the nonbinary SP algorithm is also difficult and very 
few attempts (e.g. |14|) have been made in this direction. 

An alternative decoding algorithm for binary LDPC codes, 
known as Linear Programming (LP) decoding, was proposed 
by Feldman et al. [8). In LP decoding, the ML decoding 
problem is modeled as an Integer Programming (IP) problem 
which is then relaxed to obtain the corresponding LP problem. 
This LP problem is solved with the help of standard LP solvers 
such as simplex. Compared to SP decoding, LP decoding relies 
on the well-studied mathematical theory of LP. Hence, the LP 
decoding algorithm is better suited to mathematical analysis 
and it is possible to make statements about its complexity and 
convergence, as well as to place bounds on its error-correcting- 
performance etc. However, the worst-case time complexity of 
the simplex solver is known to be exponential in the number 
of variables, which limits the use of LP decoding algorithms 
to codes of small block length. To overcome the complexity 
problem, in |9'| Vontobel et al. used techniques from LP 
and coding theory to derive a low-complexity LP decoding 
algorithm for approximate LP decoding. The complexity of 
this latter LP decoding algorithm is linear in the block length 
and similar to that of the SP algorithm. A similar algorithm 
for more general graphical models is proposed in |10|. An 
extension of low-complexity LP decoding algorithm of [9] was 
proposed and studied in [ 13 ] . 

In ifTTI . the LP decoding algorithm for binary linear codes 
was extended to the case of nonbinary linear codes. The 
nonbinary LP decoding algorithm of [11] also relies on the 
simplex LP solver and hence its complexity is prohibitively 
large for moderate and large block length codes. In this paper 
we extend the work of |9| and propose a low-complexity LP 
decoding algorithm for nonbinary linear codes. We use the 
LP formulation of nonbinary linear codes proposed in ifTTIl 
to develop an equivalent primal LP formulation. Then using 
the the techniques introduced in f5), (5), the corresponding 
dual LP is derived which in turn is used to develop an update 
equation for the low-complexity LP decoding algorithm. This 



paper follows the development of the low-complexity LP 
decoder for binary LDPC codes proposed in (9). However, 
there are three main points in which it differs from the work 
in ]9) ; first, the derivation of the primal-dual LP formulations 
for nonbinary linear codes; second, the update equation for the 
low-complexity LP decoding of nonbinary codes; and third, 
the decision rule required to obtain an estimate of the symbols 
after the algorithm terminates. 

The rest of the paper is structured as follows. We begin with 
some notation and background information in Section II. The 
primal LP is developed in Section III and the corresponding 
dual LP is given in Section IV. The notion of "local function" 
is given in Section V. Section VI presents the low-complexity 
LP decoding algorithm for nonbinary linear codes. Simulation 
results are presented and discussed in Section VII. Conclusions 
are given in Section VIII, along with future directions for this 
research. 

II. Notation and Background 

Let 5ft be a finite ring with q elements where denotes the 
additive identity, and let 5ft~ = 5ft \ {0}. Let C be a linear code 
of length n over the ring 5ft, defined by 



C = {ceW l : cH T = 0} 



(1) 



where H is a m X n parity-check matrix with entries from 5ft. 
The rate of code C is given by R(C) — log (\C\)/n. Hence, 
the code C can be referred as an [n, log„(|C|)] linear code over 
5ft. 

The set J — {1, . . . , m} denotes row indices and the set 
X = {1, . . . , n} denotes column indices of H. We use Hj for 
the j-th row of H and H l for the i-th column of H. supp(c) 
denotes the support of the vector c. For each j £ J , let 2j = 
supp('Hj) and for each i el, let Ji = supp("H J ). Also let 
dj = \Ij\ and d — m&Xj G j{dj}. We define set £ = {{i,j) £ 
IxJ : j€j,i€lj} = {(i,j)€lxj : i€l,j€Ji}. 
Moreover for each j £ J we define the local Single Parity 
Check (SPC) code 



C S = { (&«), 



ex, 



ieij 



■ H jti = 



For each i £ X, we denote by A4 C Jft^ ^-^! the repetition 
code of the appropriate length and indexing. In addition, we 
use the following notation introduced in [9|: for a statement 
A we have [A] = if statement A is true and \A\ = +00 
otherwise. Here fAj = — log [A] and [A] is Iverson's convec- 
tion i.e. we have [A] — 1 if A is true and [A] — otherwise. 
Please note that where A indicates the value of a variable, 
Iverson's convention can also be interpreted as the Kronecker 
delta function. We define the following mapping as in ifTTI . 



£ : 5ft ->• {0, 1} 9 " 1 C 



ng-l 



by 



such that, for each p E 5ft 



1. if p = a 
0, otherwise 



Building on this we define 

S: U 5R f ^ U {0,1} (5_1) *C U M^ 1 )* , 
tez+ tez+ tez+ 

according to 

S(c) = (£(ci),..., £(*)), Vce5R t ,teZ+. 
For k € K., K > 0, we define the function 

and its inverse 

^ 1 (x) = -log(a;). 

K 

For vectors / e M^ -1 )™ we use the notation 

/ = (/1 I /a I • • • I /») where V* G 1, fi = (/f Q) ) QeSR - 
We also define the inverse of 3 as 

s- 1 (/) = (r 1 (/i),r 1 (/ 2 ),---,r 1 (/j). 

Note that the inverse of S is well defined for any / £ R^ -1 )™ 
where each component f^,i€ 1, has entries from {0,1} with 
sum at most 1. We assume transmission over a g-ary input 
memory less channel and also assume a corrupted codeword 
V = (j/i » 3/2 j • * * iVn) S S™ has been received. Here, the 
channel output symbols are denoted by E. Based on this, we 
define a function A:E^(RU {ioo})^ 1 by 

A = (A(«)) agR - 

where, for each y £ E, a £ 5ft~, 



\^(y)=log(P 



p(y\Q) 
(y\<*) 



£(«) 



(x (p) ) 



pesft- 



Here p(y\c) denotes the channel output probability (density) 
conditioned on the channel input. Based on this, we also define 

A(y) = (A( yi ) I \{y 2 ) | • • • | \{y n )) . 

We will use Forney-style factor graphs (FFGs), also known as 
Normal graphs |4| to represent the linear programs introduced 
in this paper. An FFG is a diagram that represents the factor- 
ization of a function of several variables. For more information 
on FFGs the reader is referred to g), 0, Q. 

III. The Primal Linear Program 

In IfTTI the authors presented the following linear program 
to decode nonbinary linear codes: 



NBLPD (Polytope Q f ): 

min. A(y)f T 
Subj. to 

if } = J2 w j* Vj G J", V* G X,-, Va G R" 



b;=a 



Vj€j,VbeCj, 
Vj G J. 



W^',b > 

bee, 

We denote the polytope represented by the constraints of 
NBLPD as Qf. Two alternative polytope representations are 
also given in [11 1, which are both equivalent to NBLPD. It 
also possible to reformulate the constraints of NBLPD with 
additional auxiliary variables. However, to develop a low- 
complexity LP decoding algorithm for NBLPD, we use the 
approach of J9] and reformulate NBLPD so that the new LP 
formulation can be directly represented by an FFG: 

PNBLPD (Polytope Q p ): 

min. A(y)/ T 

Subj. to 

fi = Ui t o (i G T), 

((u')ef)> 

(* G Z), 






a£Ai 

E 

bee, 



li, a S(a) = u, 
P 3 ,b 2(6) = Vj 

7*,a > 

hb > o 

E T<.» = X 



Eft 



'J,b 



(i e J"), 

(i£l,a€ A), 

(i G X), 
(i e .7). 



bee,- 



= ( u i,j)]€j t U{0} 



for all i E I, 
and for 



Here u^ = («,•," )aeR- and u^ = 
j G Ji U {0}; also for i £ I, m 
j G »/, ^j = (vj t i)i e x-. We denote the polytope represented 
by the constraints of PNBLPD by Q p . It is important to 
note that along with the convex hull of the single parity- 
check code, PNBLPD also explicitly models the convex hull of 
the repetition code. The constraints of NBLPD and PNBLPD 
appear to be quite different due to the different notations. 
However, the projection of each polytope onto the variables 
denoted by / is the same in both cases, and therefore the LPs 
are equivalent from the point of view of decoding. The proof 



of their equivalence is given in Theorem 3.1 



Theorem 3.1: Polytopes Qf and Q p are equivalent from an 
LP decoding perspective, i.e. for every (/,7,/3) G Q p there 
exists w such that (/, w) G Qf and conversely, for every 
(f,w) G Qf there exist j,[3 such that (/,7,/3) G Q p . 

Proof: Suppose we have (/, 7, (3) G Q p and we define 



The final two constraints of NBLPD are obviously fulfilled. 
From PNBLPD, the following holds for (/,7,/3) G Q p : 



bee, 

bec 3 



This yields 



bec 3 

b,=a 



From the third constraint of PNBLPD, and noting that 
Ai is a repetition code for each i £ I, we have u\ a Q = 
it. /,Va G Jft , j G Ji. With this and equation ([3]l we obtain 



the following, 



(a) (a) 

U J = U ifi 



E ^ 



b£Ci.bi=a 



fi = E ^ b < Va € 3T , Vi G X, , Vj G J. (4) 



bee,- 

b,=a 



This proves the first constraint of NBLPD and hence (/, w) G 

Qf- 

The converse part of the theorem statement can be proved 
in a similar manner; the details are omitted. Since for a given 
vector /, the objective functions in both formulations always 
have the same value, the decoding performance of NBLPD 
and PNBLPD are identical. ■ 



Before deriving the dual linear program, we reformulate 
the PNBLPD so that this LP can be represented by an FFG. 
For this purpose, constraints of the PNBLPD are expressed 
as additive cost terms (also known as penalty terms). The 
rule for assigning cost to a configuration of variables is: if a 
given configuration satisfies the LP constraints then cost is 
assigned to this configuration, otherwise +00 is assigned. The 
PNBLPD is then equivalent to the unconstrained minimization 
of the following augmented cost function, 



w jt b=0j,b, VbeC^VjEj 



E x ^ + Ei/< = u ^ + E i«w = v oA 

iex (ij)e£ 

+ Y J A l {u l ) + Y,B {v ] ) (5) 



iex 



(2) 



iex 



jej 



/l„«l,0 




Fig. 1. FFG which represents the augmented cost function of 
equation pi for the example (5, 2) binary code. 



Ifi = AJ 



[/2 = A 2 ] 




1/3 = A 3 ] A 3 



IU = A 4 ] A 4 



Bi 



I in 



B,, 



[/s = A 5 ] A t 

Fig. 2. FFG which represents the augmented cost function of 
equation 19} for the example (5, 2) binary code. 



where V« € 1 and Vj £ J we use 



where m = 6i and 



-4i(«i) 



E ^ a "( a ) 



aG-Ai 



E l7i,» > 0] 
aeAi 



E tv = 1 

laGAi 



Bj(vj) 



E Pi* s ( b ) = U J 


E &.«• = ! 

beCj 





foeCj 



%,6 > 0] 



For ease of illustration we consider a (5, 2) binary code with 
parity-check matrix 



H = 



1110 
10 10 
10 1 



e = -/ = -4>i + ( -Ui, S(p) 



=► - [e > 0] 
Similarly 

- 1.9 > 0] = - 
From equation d6j, Q, ([8]) 



ij < ( -Ui, S(p) 



< ( -«i, 3(g) 



(7) 



(8) 



ii(«i) = ^ - 1^ < < -«i, E(p) )] - l$i < ( -u h E(q) 
=> Ai(ui) =$i— fa < min ( -«.„ 5(a) ) 

a£Ai 

The same procedure can be used to derive the dual of 
B j(Vj) as 



B j (v j )=0 j - 



0j < min( -v^ 3(6) 



The augmented cost function for this code is represented by 
the FFG of Figure [T] 

IV. Dual Linear Program 

The dual linear program of PNBLPD can be derived from 
the augmented cost function of equation d5). First we derive 
the dual of Ai(ui) and Bj(vj), For simplicity of exposition, 
we assume At = {p,q} = {(p , Pi , P2) , {qo , qi , Q2)} ■ The 
(primal) FFG of Ai(ui) is shown in Figure [3] and its dual is 
shown in Figure [4] The dual FFG is derived with the help of 
techniques introduced in [5| and [6|. The dual function Aj(wj) 
is derived from the FFG of Figure |4] as follows, 



We use Ai(ui) and Bj(vj) to derive the dual of the LP 
represented by equation d5), which is in the form of the 
maximization of the following augmented cost function, 



J2M*) + E 4(*i) - £l/i = -6i,o] 

iex jej iex 



Ei 



£[> 



i£X 



(9) 



A l (u l )=m-le<0l-lg<0j 



(6) 



The augmented cost function of equation (|9| for the (5, 2) 
binary code is represented by the FFG of Figure [2] 

The dual of PNBLPD can now be obtained from equa- 
tion (|9), 



[e>0] 




b>o] 



[m=l] 




Fig. 3. FFG for the function Ai(ui). This forms a subgraph of the 
overall FFG of Figure [T] 



Fig. 4. FFG for the function Ai(v,i). This FFG is dual to that of 
Figure [5] Here, for any variable x, x denotes the dual variable. 



DNBLPD: 




max. V^ 4>i + V^ 0j 




Subj. to 




fc < min (-Ui,E(a)) 

aeAi 


(*el), 


§j < min (-«.,•, 5(6)} 

beCj 


(i e .7), 


u i,j = ~ v j,i 


((U)e£), 


«i,0 = -f 4 


(iel), 


fi = A, 


(i£l). 



A. Softened Dual Linear Program 

We make use of the soft-minimum operator introduced in 
J5) and derive the "Softened Dual Linear Program". For any 
k £ K, k > 0, the soft-minimum operator is defined as 



min^jz/} 



-ilog^e— )=-^ (l>R) 

where min; ^'{2;} < min/{z;} with equality attained in the 
limit as n — > 00. With this we define the softened dual linear 
program SDNBLPD which is the same as the DNBLPD except 
that min is replaced by min ( K > . 

V. Local Function 

In SDNBLPD, cf>i and 9j are involved in only one inequality 
and hence we can replace these inequalities with equality 
without changing the optimal solution (the same is true of 
DNBLPD). With this, let us select an edge (i,j) £ £ and 



assume that the variables associated to the rest of the edges 
are kept constant; then the "local function" related to edge 



h{iii,j) 



mm 

aeAi 



(K) '-Ui,E(a)) + min ^ 



-Vj,S(b)) (10) 



Though the soft-minimum operator is an approximation of the 



minimum, its advantage can be observed from equation (lOi. 
Here, the local function would be non-differentiable without 
use of the soft-minimum operator and as we will see in the next 
section, the convexity and differentiability of h (iiij) make it 
easier to treat mathematically. 

VI. Low Complexity LP Decoding Algorithm for 
Nonbinary Linear Codes 

If the current values of variables Ui t j, (f>i, Oj related to edge 
(i,j) £ £ are replaced with the new values (at the same time 
keeping variables related to other edges constant) such that 
h(iii,j) is maximized, then we can guarantee that the dual 
function also increases or else remains constant at its current 



» 



-!<*) 



value. The new value u)"' for each u) ■ , a £ 3? which 



maximizes h(v,i t j) is given by 



(a) A 



argmax h(Uij) (Va £J? ) 



(11) 



Once we have calculated Uij, we can update the variables 
<j>i and 6j accordingly. The calculation of Uij is given in the 
following lemma. 

Lemma 6.1: The value of uf- of equation <|l lb can be 
calculated by 

1 



» 



\\Vi,a *i,<x) [^ j ,a ~ l> j ,a)) 



where, 



V it& ±- min W{-Ui,E(a)}, 

aeAi 
aeAi 



Cy.fi 4 _ pin W <-*,., S(6)) 

Q^-miiiW^,^)). 
oec. 



Here the vectors a, and a are the vectors Hi and a 
respectively where the j-th position is excluded. Similarly, 
vectors Vj and b are obtained by excluding the i-th position 
from Vj and b respectively. 



Proof: 



h (v,i t j) = min w (—Ui, S(o)) + min w (— %, 5(6)) 



(«) 



aeAi 



bec 3 






/ 



= -r 1 



2 ^(<t*i, 5(a))) + ^ ^({u,, 5(a)) 



\ 



aeAi 



aG.4; 



-V*" 1 



$>(<*;, 5(6))) + ^v(<%, 5(S)) 



\ 









-V" 1 



X] V4(«i, 5(a)) 



V 






E^g + fo, 5(a)) 



\ 



aG^ti 



/ 



-r 1 



EXto, s(&)) 



V 






+ E ^(-<? + fo. s ^> 



Now to maximize h(uij), we set 



dh(u id ) _ 1 



-KV^g^fV^) 



_i -«^(-«S } )^(^>) 



= o 



^(«S } ) H^ q + Cj < a ) = H~"$) H Fi,a + c ' j - a 



-.(«) 






uTJ + (^,« + Ci,a) = -v>% + (^,a + C ita ) 



This yields, 



Ujj — ^\\Vi,a — Vi t a) — {Cj >a — Cj,a)) 



Lemma 6.1 is a generalization of Lemma 3 of [9] to the case 
of nonbinary codes. One visible difference between the binary 
case and the present generalization is in the calculation of Vj i& 
and Cj a . Here in the case of nonbinary codes, the calculation 
of Vi_a does not exclude the j-th entry from a € Ai and Uij\ 
similarly the calculation of Cj :& does not exclude the i-th entry 
from b £ Cj and i}ji. Note that this is not inconsistent since 
is never used to update itself. Here the calculation of Vi :& 



a 



(«) 

i,3 



and Cj. & requires a £ 5ft \ {0, a} and hence £(a) is always 

multiplied with the corresponding uf' . This ensures that uf- 

( \ 
is not used for calculating u\" . 

As mentioned in [9|, the update equation given in Lemma 3 
of [9] can be efficiently computed with the help of the variable 
and check node calculations of the (binary) SP algorithm. Due 
to this, the complexity of computing (C.-Q — Cj a ) is 0(d) for 
binary codes. On the other hand, in case of nonbinary codes 
the mapping 5 used in NBLPD transforms the nonbinary linear 
codes Ai (repetition code) and Cj (SPC code) into nonlinear 
binary codes Af L = {5(a) : Va £ Ai} and Cf L = {5(b) : 
Vb £ Cj} respectively. Here, the computation of (Vj „ — Vj a ) 
and (Cj t a — Cj.a) is related to the SP decoding of nonlinear 
binary codes Af L and Cj, Ai and Cj are duals of each 
other, however such relationship between Af L and Cf L is 
not so simple. Hence the computation of (CVq — Cj a ) in the 
dual domain requires further investigation. 

One option to compute (Cj. a — C JQ ) is by going through 
all possible codewords of the SPC code Cj exhaustively. 
In this case the complexity of computing (Cj,a — Cj, a ) is 
0(q^ d ~ 1 '). However it is also possible to rewrite the equations 
for Cj^a and Cj, a as follows, 



bee j 

t i7 t a 



Similarly 



^>) = EK^ ,H(5)) 



bee. 



It can be observed from the above equations that the calcula- 
tion of the Cj t& and Cj. a is in the form of the marginalization 
of a product of functions. Hence it is possible to compute 
Cj t s and Cj <a with the help of a trellis based variant of the 



SP algorithm. The complexity of computing (Cj 



Cj',«) 



with the help of the trellis of the SPC code Cj is linear in the 
maximum check-node degree d. However, this trellis based 
approach is still under investigation and is not used for the 



simulation result given in the Section VII 



We can now formulate the decoding algorithm with the help 



of the update equation given in Lemma |6T| W e select an edge 

Then . 



6.1 



6 a and 



(i, j) G £ and calculate Uij from Lemma i 
the objective function are updated accordingly. One iteration 
is completed when all edges (i,j) € £ are updated cyclically. 
This is a coordinate-ascent type algorithm and its convergence 
may be proved in the same manner as in Lemma 4 of J9j- 

Lemma 6.2: We assume d > 3 for a given parity-check 
matrix H of the code C. If we update all edges (i, j) e £ 



cyclically with the update equation given in Lemma 6.1 



then the objective function of SDNBLPD converges to its 
maximum. 

Proof: The proof is essentially the same as that of Lemma 
4 of 0. ■ 

The algorithm terminates after a fixed number of iterations or 
when it finds a codeword. Knowing the solution of SDNBLPD 
does not give an estimate of the codeword directly. However, 
an estimate of the i-th symbol ti can be obtained from the 



vector iii.j. For this we define, 



» 



E 



-» 



» 



It is possible that the value of x\ ' is zero. In this case, 
the corresponding symbol is erased. Otherwise the symbol 
estimate is obtained as follows: 



= cHfi) 



(12) 



where 



/, 



(a) 



if x { t ] < 0, 
if x[ a) > . 



?(<*) 



If more than one f\ ' is assigned the value 1, then the 
inverse function £ _1 cannot be invoked to give the estimate 
of Ci. However, the constraints of NBLPD also enforce 



(«) 



configuration of /, 



1, and hence we will never get such a 

(a) 



The advantage of using the soft-minimum operator is evi- 



dent from Lemma 6.1 However, for practical implementation 
we are interested in k — ► oo. As mentioned earlier, in 
limit of k — >• oo, the soft-minimum operator is same as 
the minimum which requires less computation. The following 
lemma considers k^co. 

Lemma 6.3: In the limit of k — > oo, the function h(ii^j) is 
maximized by any value uf) that lies in the closed interval 
between 



(Yi, 



Vi,a) 



hJ 



and 



'\S- , j,a Cj >a ) 



10-'- 



1 ® f 1 ® f 1 * — y~— — fc~— i&_ ] 






— s£— LP Decoding 

— B- Low-Complesity LP Decoding . 
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Fig. 5. Frame Error Rate for the example [80, 48] quaternary LDPC 
Code under QPSK modulation. The performance of the low-complexity LP 
decoding algorithm is compared with that of solving NBLPD using the 
simplex algorithm. 



where 

Vi,a = - min (-Ui,E(a)) C . a = - min (-Vj,S(b)) , 

aEAi bECj 

Via — - min (-Ui,E(a)) Cj a = - min(-w,-,S(6)). 

a£At b£C; 



Proof: The proof of the lemma is same as that of Lemma 
5 of 0. ■ 

Now we can update edges (i,j) € £ cyclically where the Uij 



is calculated according to Lemma 6.3 However, in this case, 
we cannot guarantee convergence of the algorithm. This is 
because for k — > oo the objective function is not everywhere 
differentiable and it is not possible to use the same argument 



as in Lemma 6.2 This problem is also discussed in Conjecture 



6 of [9|. After the algorithm terminates, equation (12i can be 
used to get the estimate for each symbol. 

VII. Results 

In this section we present simulation results for the proposed 
algorithm. The update equation of Lemma 6.3 is used for 
simulations. Calculation of the (Cj.a — Cj. a ) is carried out 
with exhaustive search over all codewords of SPC code Cj. 
We use the LDPC code of length n — 80 over Z4, This code 
has rate R(C) = 0.6 and constant check-node degree of 5. Its 
parity check matrix can be constructed as follows: 

iti-j = {0, 41, 48} 
H u = < 3. ifi-j = {8, 25} 
otherwise. 

We assume transmission over the AWGN channel where the 
nonbinary symbols are directly mapped to quaternary phase- 
shift keying (QPSK) signals. The same LDPC code was also 
used in iTTTl . 



Figure B] shows the error correcting performance curve 
for above mentioned LDPC code. The curve marked "LP 
Decoding" uses the LP decoding algorithm of UTI with the 
simplex LP solver. All results are obtained by simulating up 
to 500 frame errors per simulation point. The error correcting 
performance of low-complexity LP decoding algorithm is 
within 0.2 dB of the LP decoder. It is important to note that the 
worst case time complexity of the simplex method has been 
shown to be exponential in the number of variables (i.e. block 
length). In contrast, the complexity of the low-complexity LP 
decoding is linear in the block length. 

VIII. Conclusion and Future Work 

In this paper we introduced low-complexity LP decoding 
algorithm for nonbinary linear codes. Building on the work 
of Flanagan et al. [11] and Vontobel et al. 0, we derived 
the update equations of Lemma 6.1 & Lemma 6.3 The 
complexity of the proposed algorithm is linear in the block 
length and hence it can also be used for moderate and long 
block length codes. However, its complexity is dominated by 
the maximum check node degree and the number of elements 
in the nonbinary alphabet. The main problem is that of the 
check node calculations. The binary repetition code is the 
dual of the binary SPC code and this fact is utilized in 
binary low-complexity LP decoding algorithm to reduce the 
computational complexity. However, for the nonbinary case, 
the relationship between the corresponding nonlinear binary 
codes is not so simple. We are currently investigating dual 
domain methods for check node processing as well as variants 
of the sum-product algorithm which operate directly on the 
trellis of the nonbinary code, with the goal of leading towards 
a complexity reduction in the check node calculations. 
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